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FOREWORD 


f  i"ie  Program  to  Develop  Efficiency  in  Visual  Functioning  .was 
made  possible  through  Grant  No.  G007605448  awarded  the  American 
Printing  House  for   the  Blind  by  the  Bureau  of  Education  for  the 
Handicapped;  U.S.  Office  of  Education;  Department  of  Health,  Educa- 
tion* arid  Welfare.  The  new  program  is  based  on  the  earlier  Uti  1  i- 
zailon  of  Low  Vision  Kit  (Barraga,  1970)  which  was  disseminated 
nationally  as  a  cooperative  project  by  the  author,  the  Bureau  of 
Education  of  the  Hanoi  capped,  the  American  Printing  House,  and  a 
national  group  of  consultants. 

7he  Utilization  of  Low  Vision  Kit  has  been  well  received  and 
widely  used  since  i  vS  publication  by  the  American  Printing  House. 
However,  research  by  Ozias  (1975)  revealed  the  need  for  extensive 
revision  and  expansion  of  both  its  components;  namely,  the  Visual 
Efficiency  Scale  and  the  Teacher's  Guide.  Tne  purposes  of  the  pro- 
ject in  which  the  new  program  was  developed  were  to  (a)  revise  and 
expand  <"he  teaching  materials,  (b)  revise  nd  expand  the  Visual 
Efficiency  Scale  into  a  diagnosti 
develop  basic  student  materials. 


assessment  procedure,  and  (c) 


The  Program  to  Develop  Efficiency  in  Visual  Functioning  has 
resulted  from  the  cooperative  efforts  of  Natalie  C.  Barraga  and 
her  staff  at  the  University  of  Texas  at  Austin,  who  were  responsi- 
ble for  developing  the  program  materials,  and  the  research  and 
development  staff  at  the  American  Printing  House,  who  were  respon- 
sible for  evaluation  of  the  materials.  Doth  were  supported  and 
assisted  by  a  group  of  knowledgeable  consultants. 
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Visual    Functioning.      Tne  program  represents  a  vastly  revised  ana 


expandea  Ut]  ;  i  zation  ct  Lev/  Vision   Kit. 
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Abstract 

The  purpose  of  the  project  was  to  develop  a  orogram  that  would 
facilitate  the  efficiency  witn  which  legally  blind  persons  use 
their  remaining  vision.  The  content  of  the  program  was  cased  upon 
a  review  of  literature  pertaining  to  low  vision,  visual  perception, 
and  visual  development  and  information  received  from  teacners  of 
the  visually  handicapped.   In  its  final  form  the  program  consists 
of  the  following  ccrponents: 

Diagnostic  Assessment  Procedure  which  is  a  40-item  instrument  for 
determining  level  of  visual  functioning  anc  identifying  appropriate 
lessons  for  use 

Design  for  Instruction  which  includes  150  lessons  sequenced  to 
increase  visual  efficiency 


bource  dook  en 
vision  and  its 
glossary,  and  i 


Low  Vision  which  includes  extensive  material  on  low 
use  as  well  as  materials  lists  for  low  vision,  a 
i  bibliography. 


Throughout  the  development  of  the  program  a 

panel  of  consultants 

reviewed  all  the  materials  of  each  componen 

t   before  they  were 

field-evaluated.  The  Diagnostic  Assessment 

Procedure  was  evaluated 

by  administering  it  twice  to  112  legally  bi 

Ind  students  ages  5-20. 

Reliability  coefficients  showed  the  Diagnos 

tic  Assessment  Procedure 

to  have  high  internal  consistency  (KR  -  20 

=  .94)  and  to  oe  highly 

accurate  (test  -  retest,  r  =  .96).   In  the 

final  phase  of  the  pro- 

ject the  complete  program  was  used  by  11  te 

spers  of  the  visually 

handicapped  with  22  legally  blind  students. 

The  program  was  given 

high  ratings  by  all  teachers.  Without  spec 

ial  training  or  ins  true- 

tions  other  than  the  instructions  provided 

in  the  program,  these 

teachers  were  able  to  use  the  program  effic 

iently  wi th  thei  r  stu- 

dents . 

In  1964  Barraga's  publication,  Increased  Visual  Behavior  in 
;w  Vision  Children,  attracted  worldwide  attention  in  the  field  of 


the  visually  handicapped.  Barraga's  (1964)  study  demonstrated  that 
trie  efficiency  with  which  handicapped  students  use  their  residual 
vision  could  be  increased  with  specific,  systematic  training.  The 
original  study  was  then  replicated  successfully  by  Ashcroft, 
Halliday,  and  Barraqa  (1955)  and  later  Holmes  (1967)  demonstrated 
the  efficacy  of  the  concept  with  older  students.   In  1970,  leaders 
in  the  field  of  the  v'sually  handicapped  recognized  t^e  acute  need 
for  a  broad  dissemination  effort  to  prepare  tochers  to  provide 
visual  efficiency  .raining  to  all  children  and  youth  with  useful 
vision,  which  constitutes  about  79%  of  those  classified  as  ''legally 
blind."  Subsequently,  the  American  Printing  House  for  the  Blind 
assumed  resporsibi  "lity  as  a  coordination  center  for  a  program  that 
published  and  distributed  materials  for  a  series  of  institutes  on 
the  utilization  of  iow  vision.   These  institutes  were  supported  by 
funds  from  the  Office  of  Education,  U.S.  Department  of  Health,  Edu- 
cation and  Welfare.  The  materials' and  training  procedures  used  in 
t  h  e  s  e  i  n  stitut.es  were  c  o  1 1  e  c  t  i  v  e  I  y  n  a  me  d  t  h  e  Oti  1  i  2a  t  ion  of  Low 
Vision  Kit. 

The  primary  components  of  the  Utilization  of  Low  Vision  Kit 
were  the  Visual  Efficiency  Scale  (Barraga,  i 970b)  and  the  Teacner's 
Guide  (Barraga,  1970a).  The  Visual  Efficiency  Scale  consisted  of 
-1  items  printed  in  black  and  white.   The  items  involve  either 
matching  or  noting  likenesses  and  differences  in  visual  stimuli 
and  range  in  size  from  large  (3/4  inch  [2  cm])  geometric  forms  to 
small  (3  point)  type.   Tne  visual  skills  necessary  to  respond  to 
the  progressively  more  difficult  items  induce  discrimination  of 
solid  and  outline  geometric  and  object  figures  in  decreasing  size; 
discrimination  of  spatial  position  and   pattern  detail  in  abstract 
figures  and  objects;  and  discrimination  of  letter  and  wor_  symbols 
singly  and  in  groups.   Instructions  for  administration  and  use  of 
the  scale  are  included.  Profile  sheets,- enable  the  teacher  to  chart 
levels  of   visual  functioning  and  assist  in  identifying  visual  skill: 
already  present  as  well  as  those  needing  to  be  learned.   From  the 
profile,  individualized  plans  for  specific  aspects  of  visual  learn- 
ing can  be  projected. 
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A  study  of  the  reliability  and  validity  of  the  Visual  Effi- 
ciency Scale  v.'i  th  lew  vision  children  (Harley  &  Spollen,,  1973) 
revealed  content  validity  and  internal  consistency.  However,  about 

1  ,'  i     n  f     «- 
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Purpose 

The  purpose  of  this  project  was  to  revise  dno   expand  the  Uti 1 i - 
zation  of  tow  Vision  Kit  into  a  more  comprehensive  and  detailed  pro- 
gram tnat  could  be  utilized  by  vision  teachers  to  evaluate  visual 
functioning  in  low  vision,  legally  blind  parsons  and  to  train  such 
persons  to  use  their  vision  more  efficiently.   The  components  of  the 
total  program  were  specified  and  included  the  follow  inn: 


1. 


4. 


!  :eme  and  Organization  of  Complete  Program  which  provides 
an  introduction  arm  overview  of  the  program 

Diagnostic  Assessment  Procedure  which  includes  instruc- 
tions for  3c:~i ni steri ng  the  procedure,  40  assessment  items 


i  'iterraca' 


nth  *  '  •'■• 


:ns  ,  and  a  i  i  materia 


needed  for 


wi  i n  the  :  sessment  i  terns 


Design  for  Instructional  Plan  which  includes  basic  informa- 
tion essential  for  implementation  of  toe  training  program 
and  150  lessons  sequenced  to  increase  visual  efficiency 

Supplemental  Source  Sook  which  includes  the  materials  lists, 
a  glossary,  a  bibliography,  and  sections  pertinent  to  the 
use  of  vision,  but  nonessential  ror  implementation  of  the 
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program  (e.g.,  major  eye  conditions  and  their  influence  on 
visua]  functioning,  magnification  and  low  vision  aids, 
illumination  and  visibility  factors,  etc.). 

Procedure 

In  order  to  develop  each  of  the  components  specified,  over  100 
articles  were  reviewed  in  the  areas  of  visual  perception  (e.g., 
attention,  fixation,  accommodation,  etc.),  normal  visual  uevelop- 
ment,  and  in  other  areas  relating  to  visual  impairment  and  low  vision 
(e.g.,  visual  acuity  and  visual  functioning,  screening  targets, 
magnification  and  optical  aids,  lighting  ana  visibility  factors, 
etc.).   From  this,  a  review  of  the  literature  was  written  (barraga, 
Collins,  a   Mollis,  197  7)  in  which  research  findings  were  summarized 
and  related  to  eight  levels  reflecting  the  normal  developmental 
sequence  of  visual  functioning,  wnich  were  as  follows: 

awareness  —  visual  sensations  and  intake  of  visual  information 

visual  information  and  beginning  discrimination  of  contours 
and  forms  in  simple  tangible  objects 

discrimination  arid  recognition  of  environmental  contours 

visual  information  and  beginning  discriminate  ,;  md  recogni- 
tion of  form  ana  detail  in  represented  material 

discrimination,  recognition,  and  perception  of  simple  and  com- 
plex pictures  of  actions,  scenes,  and  situation'; 


discrimination,  recognition,  and  perception  of  abstract  repre- 
sentations 

discrimination,  recognition,  and  perception  o?  abstract  num- 
bers arid  letter  symbols 

Simultaneously,  ar\  array   of  specific  visual  functions  (e.g.,  focus, 
accommodation,  fixation,  tracking,  etc.)  were  identified  and 
sequenced  into  optical,  optical  and  perceptual,  arid  visual  percep- 
tual categories  to  form  an  outline  for  development  o;  both  the 
instructional  program  and   the  assessment  procedure.   Tne  rationale 
for  the  program  is  based  upon  the  idea  that  the  functions  performed 
by  the  visual  system  interact  with  the  visual/perceptuai  developmental 
level  of  the  individual  in  specific  environments  to  :   'luce  a   cer- 
tain decree  of  visual  efficiency  (Barraga  &  Collins,  '}/')). 

In  addition  to  reviewing  the  literature,  visual  is  essment 
instruments  ana   teachers'  guides  on  early  childhood  readiness, 
reading  readiness,  and  visual  perceptual  development  ,-.ere  inspected 
for  content,  format,  and  packaging.   T r> i  s  information  was  used  in 
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developing  specifications  for  the  materials  that  are  included  in 
the  final  program.  Since  many  of  the  commercial  materials  identi 
fled  were  readily  available  to  teachers,  a  decision  was  made  to 
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canqible  materials  only  r; 


the  Didcnostic  Assessment  Pro- 


ceJure  and  not  for  the  150  lessons.  Lists  of  commercially  availa- 
ble materials  that  could  be  used  with  the  lessons  were  provided. 
Tr:e  materials  lists  included  annotations  and  sources.  However,  all 

graphics  for  the  lessons  were  provided. 

During  the  first  2  years  of  the  project,  drafts  of  the  Theme 
and  Organization  of  the  Complete  Program,  the  Diagnostic  Assessment 
Procedure  and  the  Design  for  Instructional  Plan  were  completed  and 
refined.   Simultaneously,  graphic  and  tangible  materials  required 
f2r   use  with  the  assessment  procedure  were  acquirec  or  developed 
Subsequently,  all  of   the  materials  were  sent  to  the  project's  con- 
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The  purpose  of   this   phase  of  the  project  was   to  psychometrical ly 
evaluate   tne   Diagnostic  Assessment  Procedure  with  respect   to   its 
interna]    consistency,    test-retest    reliability,   content,   and   construct 
validity   (Berla1,    Rankin,   It  Willis,    1920). 

Method 

Subjects .      The   subjects    for   this    study  were  selected  on    the 
:  is i s    of    me    following  criteria: 

:.      a   minimum  developmental    level   of  5.5  years    in  aoe 
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a  minimum  of  1  year  in  a  structured  educational  set- 
ting (kindergarten  and  up) 

legally  blind  (20/200  visual  acuity  or  less  in  the 
better  eye  with  corrective  lens  or  a  visual  field  of 
20  degrees  or  less)  with  a  minimum  of  light  perception 

ro  additional  physical  or  rental  handicaps  that  would 
interfere  with  performance  on  the  test 


The  subjects  were  112  legally  blind  pupils  attendin 
in  the  United  States  (California,  Georgia,  Kansas,  New  H 
New  York,  Oregon,  Texas,  Massachusetts,  Washington)  and 
(Cnrario).  All  subjects  were  volunteers.  There  were  60 
(54%)  and  52  females  (46%)  with  89  subjects  from  public 
( 79%)  and  23  subjects  from  residential  schools  (21ri).   E 
was  classified  into  one  of  nine  visual  categories  using 
fi  cation  system  of  visual  acuity  proposed  by  the  Natrona 
for  the  Prevention  of  Blindness.  For  the  purposes  of  th 
another  category  (X)  was  added  to  take  into  account  thos 
who  had  only  restrictions  in  visual  fields  of  less  than 
but  whose  visual  acuities  were  greater  than  20/200.  The 
percentage  of  subjects  in  each  of  the  visual  categories 
Table  1. 
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Table  1 

The  Number  and  Proportion  of  Subjects  in  the  Testing  Sample  for 
Each  of  the  Visual  Categories  and  the  Proportion  of  Subjects 
for  the  19  76  Quota  Registration  Reported  by  the  American  Print- 
ing House 


P    0 

portion 

?r, 

".porti 

on 

of 

1976  quota 

Visual 

teoories 

Number 

of 

s  a  mo  i 

* 

e 

(Wi 

His,    1979) 

I 

20/200 

-    18/200 

59 

.54 

.40 

II 

17/200 

-    12/200 

5 

.05 

.04 

III 

12/200 

-    08/200 

21 

.19 

.12 

IV 

07/200 

-   03/200 

4 

.  u3 

.03 

V 

2.5/200 

-    .4/200 

I 

.04 

.01 

VI 

Counts 

fi  nger 

7 

.06 

.05 

VII 

Hand  movements 

( i ncl ud 

es    ''forms"   zr 

id 

object 

perception) 

5 

.05 

.05 

III 

Light  r 
and /or 

rejection 
perception 

( i  ncluc 

es  shadows) 

6 

.05 

.12 

IX 

To  1 3  1 1  > 

blind 

u 

- 

.18 

X 

Res  trie 
field  ( 

or   less 

ted  visual 
20  degrees 
) 

TTff 

.02 

1  o 

-4.  A^, 


Note.  The  inforration  on  two  subjects'  visual  acuity  was 
incomplete  and  consequently  the  data  reported  in  this  table  were 
based  on  110  subjects  instead  of  112.  The  reader  should  note  that 
the  visual  categories  in  this  study  were  slightly  different  from 
those  used  by  Willis  (1979).   If  the  Willis  date  were  recalculated 
to  conform  to  this  category  system,  then  it  would  slightly  increase 
all  of  the  percentages  she  retorted.  As  a  consequence,  these  sample 
proportions  would  approximate  her  population  proportions  e"en  more 
closely  than  they  already  do.  These  proportions  compare  favorably 
to  those  reported  by  Willis  (1979)  using  the  1976  quota  registra- 
tion figures  of  the  legally  blind  students  attending  residential  and 
public  schools  in  the  united  States  as  compiled  by  the  American 
Printing  House  for  the  Blind.  Consequently,  the  results  of  this 
study  can  be  generalized  to  the  legally  blind  population  of   school 
age  students.   The  reader  should  note  that  totally  blind  persons 
were  excluded  from  this  study  and,  consequently,  there  were  no  stu- 
dents classified  in  catecory  IX. 

The  incidence  of  the  eye  disorders/causes  represented  in  the 
subjects  is  snown  in  Table  2.  The  reader  should  note  that  the  total 
incidence  of  211  exceeds  the  sample  size  of  112  because  most  of  the 
subjects  were  diagnosed  as  having  mere  than  a  single  eye  disorder. 
Trie  large  nu:czer   of  eye  disorders  in  the  sample  attests  to  the  great 
heterogeneity  of  visual  disabilities  in  the  population. 

8 

jj 

The  subjects'  ages  ranged  from  5-20  years.  The  median  age  was 

10.5  years . 

; 

Table  2 

Diagnoses  and/or  Causes  of  the  Eye  Disorders  Represented 
in  tne  Testing  Sample  (Arranged  by  Incidence) 

i 

Na-ffig  given  Incidence 

1.  Nystagmus  33 

2.  Cataracts  22 
1                  3.  Myopia  13 

4.  Optic  Atrophy  13 

5.  Albinism  II 

6.  Aniridia      ""•  9 

7.  Aphakia  (5  indicated  as  surgical)  8 
j                  8.  Glaucama  8 

9.  Colu~.ba  7 

10.  Estotropia  5 

11.  Microphthalmos  6 

12.  Retrolental  Fibroplasia  (RLF)  5 

13.  Emblyopia  4 

14.  Enucleation  4 

15.  Retinitis  Pigmentosa  4 
15.  Rubella  4 
17.  Exotropia  3 
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'able  2  (cont. } 


Name  qive.n 


Incidence 


lb 
19 

20 
21 
22 
23 

24 

25 
26 

27 
£8 
29 

31 

32 
33 


35 
37 

33 
39 
40 
41 
42 
42 
44 
45 
45 
47 

48 
49 
50 
51 
52 


My opi  c  As  t i  gmati s n 

Retinoblastoma 

Aebiomatc  psia 

Astigmatism  (see  33,  also  18) 

Corneal  Scarring 

Hyperopia 

Hypoplasia 

Macular  Degeneration 

Optic  Nerve  Damage 

Retinischis 

Abnormal  Macula 

Abnormal  Optic  Nerve  Function 

Anomalies  (multiple) 

Anterior  Clevage  Syndrome 

Batten's  Disease 

Choroidi toid 

Coats'  Disease 

Corneal  Vascularization 

Gun  Wound 

Histoplasmosis 

Hyperopi c  Asti gmati  sm 

Hyperplastic  Primary  Vitreous 

Microcornea 

Myopic  Degeneration 

No  Diagnosis 

P  h  o  to r  hobi  a. 

Prosthesis  (same  as  14) 

Ptosis 

Reti  nal  Degenerati on 

Retinal  Hypoplasia 

Schisis  of  Retina  (see  27) 

Strabismus 

Tapeto 

Toxoplasmosis 

Tumor 

Viral  Encephalitis 


Total 


211 


Materials 

.     If 

ie 

items   ranging 
difficult   iterr 

from 
s   of 

t 
w 

40   i  terns    of  tr 

e  Dii 

'-9 

into  eight  cat 

eqor 

[  p 

tasks.     Becaus 

e  ce 

"t 

others,  a  diff 

eren" 

r 

sample  the  beh 

avio 

"S 

gories  wi  th  tr 

e  numb 

ses) ,  along  wi 

th  exa 

Diagnostic  Assessment  Procedure  consists   of  40 


ie  simple  task  of  d< 


ing  a   light   to  the  most 


riting   letters   and  reading  simple  words.     The 
nostic   Assessment  Procedure  are  broken  down 
s   that  correspond  to  soecific  functional   visual 
ain  categories  were  more  heterogeneous  thant 
number  of  questions  were  required  to  adequately 

in   the   different  categories.     The  eight  cate- 
er  of  items   in  each  category   (shown  in  parenthe- 
mples  of  test  objectives,   are  as   follows: 


A.  Awareness  of  visual  stimuli  (2) 

Item  No.  1.   "Learner  will  turn  eyes,  head,  and/or  body 
to  1 i ght  source. " 

3.  Movement  control  of   eyes,  discrimination  of  shape  und 
color  (4) 

Item  No.  3.   "Learner  will  look  from  one  light  to  the 
other." 

C.  Exploration,  discrimination,  use  of  objects  (6) 

Item  No.  7.   "Learner  will  see  two  lines  and  move  between 
them." 

D.  Discrimination  and  identification  of  pictures  of  objects, 
people,  actions  (12) 

Item  No.  14.   "Learner  will  match  solid  color  geometric 
shapes  in  pictures . " 

E.  Memory  for  detail,  part  whole  relationships,  figure-ground 
discrimination  (4) 

Item  No.  25.   "Learner  will  identify  object  partially  hid- 
den in  picture." 

F.  Discrimination,  identification,  reproduction  o^  abstract 
figures  and  symbols  (4) 

Item  No.  29.  "Learner  will  match  abstract  figures  by 
single  inner  detai 1 . " 

G.  Perception  of  relationships  in  pictures,  abstract  figures, 
symbols  (4) 

Item  No.  33.   "Learner  will  relate  inner  detail  in  figures 
of  di fferent  size. " 

H.  Identification,  perception,  reproduction  of  symbols  of 
single  and  combined  symbols  (4) 

Item  No.  37.   "Learner  will  identify  letters  in  different 

type  styles . " 

Each   item  specifies   the  visual    task,   the  materials,   the  direc- 
tions   for  administering  the   item,   and   the  specific   response  required 
of  the   learner  in  ordar  to  be  considered  correct. 

All   materials  specific   to  administering  an   item  are  self-con- 
tained. 

10 
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Procedure.  Twelve  teachers  of  the  visually  handicapped  were 
selected  to  be  evaluators.  The  criteria  for  selection  were  as  fol- 
1  ows : 

1.  Interest   in  participating 

2.  Experienced   in    testing  procedures,   specifically   in 
using   the  Visual    Efficiency   Scale   (Barraga,    1970b)    for 
the  assessment  of   low  vision 

3.  Able  to  assess    10  or  more  students  who  met  the  criteria 
for  participation   in   the  study. 

Each   teacher  was    required  to  attend  a  2   1/2  day   training  session 
held  at  the'American  Printing  House  for  the  Blind  during  the  sunnier 
of  1978.      During  the  training  sessions   the  rationale  of  the  program 
was   given  along  witn  a  demonstration  in  administering  the  entire 
assessment  procedure.      The  teacher-evaluators   then  returned  to  their 
respective  communities   to  assess   their  students.      Each  teacher- 
evaluator  was   asked  to  test  and  retest  each  student  within  a   period 
of  not   less   than  2  r.or  mere   than  3  weeks   curing  the  fall   of  197S. 
The  teacher-evaluators  were  paid   for  their  participation  in  the 
training  session  arc   for  escn  set  of  test-detest  protocols   returned 
to   the  American  Printing  house  for  the  Blind. 

Results   and  Discussion 

This   instrument  was   examined  for  content  validity  as  well   as 
from  a  psychometric   standpoint.     Roth  these  standpoints   are  essen- 
tial   to  the  users   of  this  instrument  because  a  person's   performance 
on   the  categories   of  the  test  are  more  important  to  the  examiner 
than  the  total    test  score   (i.e.,   educational   planning  and  educa- 
tional   intervention  will   be  tased  on  performance  within  the  eight 
categories   rimer  than  on  the  test  as  a  whole). 

The  content  validity  of  the  Diagnostic  Assessment  Procedure  is 
quite  good.      In  constructing   the  test  the  developers   reported  review- 
ing over  100  articles   and  books  on  visual    perception,   normal   visual 
development,   visual    impairment,  and  low  vision.      In  addition,   14 
professionals   in  the  areas   cf  visual   perception,   low  vision,   and 
teachers  of  the  visually  handicapped  served  as  consultants   on   the 
project.     The   literature   review  and  the  input  from  the  consultants 
provided  the  basis    for  the  development  of   the  eight  functional 
visual    categories   and  the  specific   items   on   the  instrument.     The 
eight  categories  of  the  instrument  appear   to  be  very  comprehensive 
in  covering  the  full    range  of  visual      functioning.      In  addition 
the  items  on   the  instrument  are  representative  of  the  visual   abili- 
ties   that  would  be   necessary   in   performing  a  wide  range  of  school 
related  visual    tasks. 

The  means,   standard  deviations,   and  standard  errors   of  the 
means    for  the  test-retest  protocols  arc  shewn  in  Table  3.     The 
average  subject  obtained  a  score  of  approximately   70%  on  both   the 
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test  and  ret.est  indicating  that  the  Diagnostic  Assessment  Procedure 
was    rather  easy.     A  statistical    test   for  skewness   of  the  distribu- 
tion rvas  significant   (p_  <^    .05).      Visual    inspection  of  the  distri- 
bution showed  a  negative  skewed  curve  with  cost  scores   piled  up  at 
the  high  end  of  the  distribution. 

Table   3 

Descriptive  Statistics    for  the  Test  and  Retest  Assessrent 


Assessment 

Mean 

Stand; rd 
deviation 

Sta 

ndard  error 
of  mean 

Test 

Retest 

23.4  (71?,) 
23.9  (72%) 

8.5 
8.1 

.31 
.76 

A  comparison  of  the  means   and  stardard  deviations    for  both   the 
test  and   retest  demonstrated  a  high   decree  of  consistency  of  visual 
functioning   over   the  period  between   test  and   retest  with   respect 
to  both   average   level   and  degree  of  homogeneity  among   individuals 
in   the  group.      The  small    standard  errc  of  the  mean   indicates   that 
there  is   a   probability  of  p   <   .01    that   the  mean  score  for  the  pop- 
ulation is    less   than   two  points  on  either  side  of  the  test  and 
retest  rruans  . 

Item  analysis  .      No   negatively  discriminating   items  were   found 
as   a   result  of  either  the   test  or  retes 
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However,  there  were  a 
iifficulty  from  other 


items  on  the  test  which  warranted  special  attention.  Table  4  shows 
the  list  of  difficult  items  for  both  the  test  and  retest.   It  should 
be  noted  that  the  same  items  were  found  to  be  difficult  on  both  the 
test  and  retest.  An  analysis  of  these  items  revealed  that  they 
tended  to  demand  drawing  and  graphic  manipulative  skills  wnich 
predictably  would  be  difficult  for  persons  with  visual  handicaps. 

Table  4 

Difficult   Items   in  Test  and  Retest  Assessments 


Iter 


Test  assessment 


Difficulty   (%) 


Retest  assessment 
Item  Difficulty  {%) 


9 

17 
30 
34 
37 
33 


25 
23 
21 
12 
26 
41 


9 

17 
30 
34 
37 
38 


17 
17 
9 
11 
22 
30 
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Reliability  estimates  for  the  Diagnost 
were  based  upon  internal  consistency  coeffi 
Richardsen  20)   and  correlations  between  tes 

The  reliability  coefficients  and  standard  e 
shewn  in  Table  5.  The  internal  consistency 
retest  were  identical  and  very  high,  _r  =  .9 
ment  were  extremely  small,  and  it  can  be  co 
dual's  true  visual  efficiency  score  would  p 
found  within  plus  or  minus  two  points  on  ei 
as  measured  by  this  test.  The  test-retest 
which  indicates  that  the  Diagnostic  Assessm 
accurate  instrument  and  that  the  type  of  vi 
by  the  Diagnostic  Assessment  Procedure  does 
to  week. 


ic  Assessment  Procedure 
cients   (i.e.,   Kuder- 
t  and  retest  results. 
rrors  of  measurement  are 

of  both   the  test  and 
4.     The  errors  of  measure- 
ncluded  that  an  indivi- 
rcbably   (p_  <^   .68)   be 
ther  side  of  his  score 
correlation  was   r  =   .96 
ent  Procedure  is  a  highly 
sual    functioning  measured 

not  vary  much   from  week 


Table   5 

Reliability  Coefficients  and  Standard  Errors  of 
Measurement  for  the  Test  and  Retest  Assessment 


Assessment 


KR  20 


Test-Retest 
correlation 


rest 

Standard  error 
Retest 
Standard  error 


1.9 


.96 
1.7 

1.6 


Hierarchial  sequence.  It  could  be  hyp 
archical  sequence  from  easy  to  difficult  it 
ment  procedure.  Such  a  hierarchy  ray  exist 
types.  One  type  of  hierarchy  (Type  A)  woul 
culty  of  the  items  progressed  systematical! 
the  end  of  the  instrument.  This  type  of  hi 
progressive  decrement  in  the  mean  percentag 
A  through  H  which  would  consist  of  clusters 
sequentially  frcm  the  beginning  to  the  end 
second  type  of  Hierarchy  (Type  B)  would  be 
that  a  state  of  interdependency  exists  amon 
Success  at  lower  levels  in  the  structure  wo 
an  individual  could  respond  adequately  to  i 
in  the  hierarchical  structure.  A  Type  A  hi 
but  not  a  sufficient  condition  for  a   Type  B 


othesized  that  a  hier- 
ems  exists  in  the  ass  ess  • 

in  one  or  both  of  two 
d  exist  if  the  diffi- 
y   from  the  beginning  to 
erarchy  would  produce  a 
e  scores   for  categories 

of  items  organized 
of  the  instrument.     A 
based  on  the  assumption 
g   items   (or  categories), 
uld  be  necessary  before 
terns   at  higher  levels 
erarchy  is  a  necessary 

hierarchy. 


Evidence   for  a   Type  A  hierarchy. 

1.     Hierarchy  of  item  difficulty 

Space  precludes   the  description  of  item  difficul- 
ties  for  ail   40  items,   but  a  visual    inspection  of  item 
difficulty   percentages   in  the   item  analysis   print-out 
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sheet  revealed  a  slight  but  nonsignificant  tendency 
(Kruskal-Wallis   test,   p_  >■    .05)   for  later  items   to  be 
slightly  more  difficult  than  early  i  terns   in   the 
sequence.      However,  a   number  of  erratic   fluctuations 
in  difficulty  are  in  evidence  from  the  beginning  to 
the  end  of  the  instrument.      Consequently,    this   evidence 
does    rot  support   trie  notion  of  a  nierarchy  of  item 
di  fficul  ty. 

Hierarchy  of  category  difficulty 

If  there  is   a   hierarchy  of  category  difficulty   then 
there  should  be  increasing  difficulty  across   categor- 
ies.     Table  6   presents  mean  percentage  scores    for  cate- 
gories  A-H   for  both   the   initial    test  and   the  retest 
resul  ts . 

Table  6 

Mean  Percentages   for  Categories   A-H 
on   the  Initial   Test  and  Retest 


Initial 

Number 

Initi 

al 

Retest 

test 

Retest 

of 

tes  l   m 

ean 

mean 

Category 

mean 

mean 

i  t  ems 

cercen 

tace 

percentage 

A 

1  .37 

1.91 

2 

94 

96 

B 

3.59 

3.70 

4 

90 

92 

C 

4.64 

4.63 

6 

77 

77 

D 

8.S5 

9.25 

12 

74 

77 

E 

2.75 

2.92 

4 

59 

73 

F 

2.69 

2.50 

4 

57 

52 

G 

2.24 

2.33 

4 

55 

58 

H 

1.79 

1.73 

4 

45 

43 

H    = 


I  \l 


The  rank  order  of  mean  percentages   for  the   initial    test  range 
is   a  descending  hierarchy   from  a  high  of  94%  for  category  A  to  a   low 
of  45%  for  category  H  and  thus   provides   evidence  for  the  existence 
of  a  Type  A  hierarchy  for  the  category  structure.     The  retest  results 
are  similarly  hierarchical    in  structure  with  the  exception  of  cate- 
gory D.     However,   the  initial    test  provides  better  evidence  for  the 
existence  of  a  hierarchy  because  it  was   not   influenced  by  potential 
practice  effects   that  may  have  occurred  on   the  retest. 

Evidence   for  a   Type  B  hierarchy.      If  a  state  of  dependency 
exists   among  i  terns  Tor  categori  espn  a  hierarchial   structure  such 
that  success  on   tasks  at  a   given   level    in  the  hierarchy  is   dependent 
upon  the  mastery  of  other  tasks  at   lower  levels,   then  correlations 
between  items  at  a  particular  level   and  items  at  successively  higher 
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levels  should  become  progressively   lower.     Similarly,  correlations 
between  items   at  a   given   level    and  other  items   at  successively 
lower  levels   should  become  progressively   lower.      Two  different  types 
of  analyses  were  conducted  as   follows: 

1.  Items--Tetrachoric  correlations  «ere  computed  among   all 
possible   combinations   of  items.   -.Such   correlations 
describe   the  strength   of  the  relationship  between 
passing   versus    failing  on  one   item  and  passing  versus 
failing  on  another   item.     Space   Goes   not  permit  a 
listing  of  all    of  these  correlations.     However,    it 

can  be  reported  that  no  trend  existed  among  these 
correlations  in  keeping  with  the  assumptions  of  a 
Type  8  hierarchy  among   items    in   the   test. 

2.  Categories  —  Tables   7  and  8  provide  evidence  related 
to   the  possibility  of  a   Type  3   hierarchy  among  cate- 
gories  A-H. 

Table   7 

Correlations  Among  Categories  A-H 
on  the  Initial  Test 


Cate- 
gori es 


A 
B 
C 

D 

E 
F 
G 
H 


X 


1.00    .72 
X 


72   1.00 


.67 


59 


61 


44 


<r 


2d 


76 


.43    .59 


70 


:•  60^ 


.67    .59 


43    (V61 


71    (.76) 
X      — J 


59 


71    1.00 


72 
X 


.61    (.64 


72   1.00 


X 


76    1.00 


.64> 


72  j   '.68 


75 


62 


.62   1.00 


40    .58'    r.63>   .52 


60 


.54 


72 


«.  6 


V 


64    1.00 


.do 


.40 


63N 


52 


63    1.00 


N  =  112 

<-— —>   Arrows  indicate  direction  of  predicted  trend. 

(^  J         Circles  indicate  deviation  from  predicted  trends. 
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The  inte 

cor  re  I  at. 

tion  of 

in  Table 

mary  of 

in  keeoi 

tions   am 

given   ca 

an   incnv 

succeed 

r-correlati ons  shown  in  Table  7  snow  a  general  tendency  for 
ion  trends  to  conform  to  predictions  made  from  the  assump- 
a  Type  8  hierarchy.   The  encircled  correlation  coefficients 

7  represent  deviations  from. the  predicted  trends.  A  sum- 
results  in  Table  8  shows  that  73b  of  the  correlations  were 
ng  with  the  nierarchial  hypothesis.  However,  the  ccrrela- 
ong  all  categories  (including  those  far  removed  from  a 
tegory  level,  are  too  hign  to  permit  the  conclusion  that 
idual  who  does  not  succeed  at  a  particular  level  cannot 
at  higher  levels  of  visual  functioning. 


"able  8 


Percentage 


-if  r 


Correctly  Predicted  Correlations 
on  the  Initial  Test 


Category 


Percentage 


86 
71 
86 
86 
71 
57 
57 
71 


Mean  =  1, 


u   = 


112 


In  summary,  for  individual  items,  no  evidence  exists  to  sup- 
port the  assumption  of  either  type  of  hierarchy.  At  the  level  of 
categories,  however,  it  can  be  concluded  that  a  Type  A  hierarchy 
exists  but  not  a  Type  B  hierarchy.   In  other  words,  significant 
differences  in  difficulty  exist  as  one  proceeds  from  the  early 
category  of  items  to  the  later  categories  in  this  test.  However, 
many  exceptions  exist  to  the  notion  that  later  categories  cannot 
be  responded  to  adequately  by   an  individual  who  does  not  succeed 
at  lower  categories. 


Construct  v 
conducted  on  the 
that  one  .'actor 
tor  accounted  fo 
were  indicated, 
were  loaded  on  f 
i  ngs  on  ) 7  i  terns 
these  results,  i 
between  the  fact 
categories  A-H. 
items  for   a  give 
would  show  low  1 
found. 


alidi  ty  of_c ?,  t e_o or 

initial    test   resu' 
accounted   for  91'. 
r  about  5b  of  the 
but  v,ere  probably 
actor   1 .      The  secoi 
Wi thout  goi ng   i 
t  can  be  said   that 
or    leading    for   ind' 

If  these  categori 
n  category  would 
oadings  on  othei 


ies 

A-H  . 

A  fa 
fact 

ctor  analysis  was 

its 

Th  p 

or  analysis    revealed 

of 

the  va 

rianc 

e  and  a  second   fac- 

V6T 

iance. 

Thr 

ee  other  factors 

not 

v  a  1  i  d 

.      Most  of  the   items 

nd 

factor 

nad 

high   factor   load- 

nto 

a  oet 

a  i  lee 

description  of 

there  wa 

s    no 

correspondence 

iv idual    i 

terns 

and    the   hypothesized 

es 

had  co 

nstri 

ict   validity,   then 

aad 

hi  cni 

y   on 

that  category  but 

ate 

gories 

.      Si 

ch   results  were  not 
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Visual  inspection  of  inter-correlations  a~cng  categories 
revealed  modest  arc  significant  correlations  tming  all  categories. 
In  fact,  the  correlations  between  test  and  recast  results  for   the 
same  categories  were  not  substantially  larger  than  the  correlations 
among  different  categories. 

It  can  there  fere  be  concluded  that  these  categories  lack  con- 
struct validity.   There  is  little  evidence  the:  this  instrument 
measures  any  cluster  of  traits  corresponding  t;  the  hypothesized 
category  system.   From  a  measurement  point  of   ..;,  even  if  these 
categories  were  valid,  cue  to  the  high  correlations  among  all  cate- 
gories, the  error  of  measurement  among  categories  would  be  too 
large  to  permit  any  diagnostic  interpretation  to  be  placed  upon 
differences  among  category  scores  unless  such  differences  were 
ratner  large. 


It  should  be  said,  however,  that  the  requirements  fcr  factoria 
construct  validity  are  so  rigorous  that  few,  if  cny,   psychological 
or  educational  measuring  instruments  meet  such  criteria  tocay. 


Most  published  reacing  tests, 


example,  report  substantial  inter- 


correlated  subtest  scor-.-s  to  be  used  for  diagnostic  purposes,   ractor 


analysis  ot  sucl 
subtest  titles. 

tools  .   They  ma> 


tests  seldom  reveal  factors  c< 


?s  ponding  to  most 


these  tests  are  ooviously  useful  diagnostic 


disolav  adequate  content  valid 


related  validity  despi 


ick  of  factoria 


■  and  criterion 
i  di  ty . 


nevertheless  be  feasibi 


Paradoxically,  despite  the  previously  discussed  results  con- 
cerning uie  lack  i   construct  validity  of  this  instrument,  it  would 

;o  use  this  category   stem  as  an  organiza- 

■eatment  procedures  . 
The  rationale  for  this  decision  would  rest  upon  both  the  substantial 
content  validity  or"  this  instrument  and  an  expected  Type  A  hierarchy 
among  categories,   "he  content  of  this  instrument  was  based  upon  a 
rational  analysis  by  professionals  in  t  r.~   field  of  the  visually 
handicapped  as  well  as  psychologists  who  were  knowledgeable  in  the 
field  of  visual  perception. 


If  the  category  structure  were  to  be  used  as  a  diagnostic  tool 

justified  on  pragmatic  if  not  entirely  on  rigorous  psychometric 

grounds,  it  would  be  necessary  that  these  categories  possess  a 

reasonably  high  degree  of  reliability  and  a  low  degree  of  measure- 


ment error, 
decision. 


Results  in  Tables  6  &nd  9  provide  evidence  for  this 


17 


o  /"■> 


c 

,  ■) 

D 

.  i  9 

E 

.  1  5 

F 

.  "6 

G 

.5  9 

H 

.  :  3 

Table  9 

Reliability    Coefficients   ana  Standard  Er^or  of 
Measurement  for  Categories   A-H 

Standard  error 
Category  Rel  i_a_oi  1  i  ty  * SO** of  measurement** 

A  .53  .41  .17 

B  .91  .35 

1.31  .59 

2. 84  .94 

1.26  .62 

.97  .47 

1.13  .63 

1 . 44  . 59 

N   =    112 

*   Correlations  between  pre  and  post  assessment. 

**  Based  on  pre-assessment  results. 

It  can  be  seen  t~at  the  reliability  coefficients  in  Table  9 
are  surprisingly  hie*-  (considering  the  small  number  of  items  in 
each  category)  and  -e  errors  of  measurement  are  vary  low.  Also, 
the  similarity  between  test  and  retest  means  in  Table  6  indicates 

It  should  be  noted,  Krwever,  that  the  reliability  coefficients  i,see 
Table  9)  for  catec  ries  F  and  G  are  lower  tnsn  the  coefficients  for 
the  other  categories.   Careful  study  should  ce  given  to  the  "items 
in  these  two  categories.  Results  for   categories  F  and  G  shown  in 
Tables  7  and  9  alto  suggest  that  some  unidentified  problem  exists 
among  the  items  in  these  categories.  That  is  to  say,  the  predicted 
correlation  trends  in  these  tables  for  categories  F  and  G  are  less 
precise  than  for  other  categories. 

One  of  the  limitations  of  the  preceding  analysis  concerns  the 

nature  of  the  population  sample.  The  results  were  limited  to  those 
individuals  who  were  selected  on  the  basis  of  visual  acuity  of  29/200 
or  less  with  "no  additional  handicaps  (mental  or  physical)  that  might 
interfere  with  their  terformance  on  the  test.   Furthermore*  since 
the  population  of  visually  handicapped  persons  is  quite  heterogeneous 
with  respect  to  the  nature  of  the  eve  disorder  as  well  as  visual 
acuity  end  visu.:ii  fie'd,  it  is  an  open  question  as  to  the  nature  of 
trie  relationship  between  these  visual  characteristics  and  perfor- 
mance.  Emo) rica! ly ,  this  is  a  difficult  problem  to  investigate  due 
to  the  small  number  of  persons  that  would  rail  into  any  category. 

In  conclusion,  t-e  Diagnostic  Assessment  Procedure  is  a  highly 
accurate  instrument  wnich  also  displays  a  high  level  of  content 
validity  for  its  purpose.  More  evidence  is  < ■  ~.e6e6   concerning  the 
correlation  of  performance  of  this  instrument  ri'.i   related  variables 
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to  determine  its  criterion  related  validity, 
this  program  the  Diagnostic  Assessment  Procedu 
to  be  we'll  designed  for  identifying  effective 
for  use  with  individuals. 

F i e 1 d  Eva  1 ua ti on  of  the  Program  to 
Efficiency  in  Visual  Function: 


i thin  the  context  of 

re  instrument  seems 
-raining  procedures 


eve  loo 


The  purpose  of  the  final  stage  of  the  pre 
the  program  under  actual  conditions  of  use  by 

handicapped  students  in  both  residential  and  : 
to  determine: 


:ct  was  to  evaluate 
•achers  of  visual  ly 
lie  school  programs 


1.  the  extent  to  which  teachers  could  use  the  program  without 
training  or  additional  aid 

2.  if  there  were  any  materials  or  procedures  that  needed  to 
be  modified  before  the  program  was  finalized  for  produc- 
tion 

3.  how  the  program  was  usee  by  the  teach ers  and  hew  effective 

7  '    L;  3  c 


Method 


Subjects.     The  subjects   for   this   evaluation 
of  legally  blind  students  who  were  able   to  wor* 
visually  handicapped  students.      Tee  criteria   fci 

were: 


i  were  1 1  teachers 
wi  th  nnp  ^;o  three 
■  teacher  selection 


1 


interest   in  participating 

fami  1  iari  ty  w i  th   the   Utilization  c 


access  to  one  to  three  legally  bli? 
the  early  part  of   the   1979-30  scno: 

time  to  schedule  a  minimum  of  30  rv 
days  per  week,  for  a  period  of  8  «• 
cent. 


d  students  during 
1  year 

nutes   p>2r  day,   3 
eks  wi  th  each  stu- 


The   teachers  were  selected   to   represent  a   \ 

zmz   as  well    as   public  and  residential   schools. 

teachers    from  resicential    schools   and   five   fro"" 

:•    1!    teachers  were   from  the   following  states: 

'ebraska,    'lew  Jersey,    New  Mexico,   North  Carol  it 

Virginia,   and  Wisconsin. 

The  students   assessed  by  each    teacher  were 
can   Printing   House    for   the  Blind   project  staff 
tie.]    students   enrolled   in  a   particular   teacher' 
The  criteria    for  selection  ^ere: 


de  geographical 
There  were  si  x 
:ublic   schools. 
Arkansas,   Louisiana, 
,   Minnesota,  Ohio, 


e  1  ec  ted  by  Amen  - 

■en  1  i  sts  of  poten- 

oroqram  or  school . 
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1 .  legally  blind--! ight  perception  to  20/200  and/or  a 
v i s u a ]  f i eld  of  20  d e c rees  or  less 


L 

: 

were  s 

:  , 

ranged 

i 

10.7  y 

. 

in  the 

s 

the  to 

*■  ."i 

number 

0 

more  t 

a  a 

public 

r- 

The  nu 

rb 

sugges 

t  G 

is  she 

/n 

2.  a  minimum  of  1  year  of  educational  experience 

3.  willingness  of  student  and,   where  appropriate,  parent 
or  ruaraian  to  parti ci rate. 


ng  these  criteria,  22  students  (11  males  a 

ected  to  participate  in  the  field  evaluation.  The  s 

n  age  from  5.6  years  to  18.5  years  with  an  average  a 

rs .  The  eye  conditions  listed  by  incidence  as  re:jrf: 
ample  are  shown  hi  Table  10.  The  reader  should  note 
]  number  (33)  of  eye  disorders/diseases  exceeds  the 
f  subjects  22)  in  the  sample  because  several  subjec 
n  one  aisorder/disease.  Eight  subjects  (36.4*)  were 
chools  and  14  seajects  (63.6%)  were  from  residential 
:r  of  subjects  in  each  of  trie  nine  visual  categories 
d  by  the  National  Society  fzr  the  Prevention  of  Blin 
in  Table  1 1 . 


les) 

tudents 

ge  of 

sen ted 

that 

total 

ts  had 

from 

schools 

as 

dness 

"able 


r  I  -   -,  r  n 


noses 


i/or  Causes   of   the   Eye 


Represented   in   the   Testing  Sample   (Ann 


sordcrs 
i  by   Incidence' 


.  .'  a   conditions 

(or  c a -j se  of  bl  i  rdr.ess ) 


Nystagmus 

i rac ts 
G  i  auCCma 

Optic  atrophy 
Cotic   nerve  damage 
Albi nisn 
Esotrooia 

tinal   detachment 
A ;  • :  a  k  i  a 

I  c  a  o  ma 
Cornea  !    sc^rrM  a 

a    injur/ 
Hemi a  no ps i a 

"  ?.  r o  o  i  c  -s  s t  i  q  ""a  t  i  s  m 

r atoconus 


.-'.no  lental 
i  1  a 
Toxop lasmosi s 


1  b  ro  o  1  a  s  i  a 


?n 


1  - 


.    Table   11 

"he  Number  of  Subjects   in  the  Testing  Sample  for  Fach 
of   the  Visual    Categories   as   Suqqeste-d  by   the 


National   Society   ior  the  Prevention 
Visual   Categories 


i  p.cness 


■umber  of  sub  ;octs 


18/200 


I   20/200 
II   17/203  -  13/200 
III   12/200  -  08/200 
IV  07/200  -  03/200 
V  2.5/200-  .4/200 
VI  Count:  fingers 
VII  Hand  movements  (includes  "forms'*  and 
object  perception) 
VIII  Light  projection  and/or  perception 
(include::  shadows) 
IX  Totally  blind 
Not  reported 


Materials .  Each  teacher  was  sent  a  full  set  of   materials  con- 
training  all  four  components  of  the  program.  ""!:ese  included: 

Section  I    There  and   Organization  of  Complete  Program 

Section  II   Diagnostic  Assessment  Pre  cure 
Sec t i on  III 


I  }a<;  ten 


Section   IV 


iource  Book  on  low  Vision 


Additionally,   Q&cft   teacher  was  sent  an  appropriate  number  of   low 
vision  observation  checklists   and  record  booklets   and  two  question- 
naires  designed  to  evaluate   the  use  of  the  program  by  critiquing 

each  component  of  it. 

One  questionnaire  was  dn   individual  lesson  evaluation  fori 
which  consisted  of  10  yes/no  questions  with  space  provided  for 
reasons/suggestions  beside  each  question.  The  aim  of  the  question- 
naire was  to  determine  whether  a  specific  lesson  used  by  a  tocher 
aas  clear,  useful,  and  accomplished  the  teaching  objective.  A  copy 
of  this  questionnaire  is  provided  in  Appendix  3 

■'■-.other  questionnaire  was  designed  to  evaluate  the  entire 
Program  to  Develop  Effici enc^  in  Vi s ua 1  Funct i cni rig .  The  question- 
naire consisted  cm  59  yes/no  questions  with  space  provided  for 
reasons/suggestions  beside  eacn  question,   fhe  questionnaire  was 
divided  into  secarate  comoonents  and  subcomponents  so  that  each  of 


"i  could  be  evaluated  individua 


The  components  and  subcom- 


ponents ot  the  program  evaluated  by  this  questionnaire  were  as 
rol  lews : 

1 .  Purpose 

2.  Use  of  each  program  component 
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2. 


--..-'  - 


3.      Program  guide 


4.     Diagnostic  Assessment  Procedure 


a.  Preface 

b.  Evaluator's  guide 

c.  Assessment  items 

d.  Assessment  materials 

| 

e.  Instructional  planning  index 

i 

f.  Record  booklet 

c.  Demographic  sheet 
■ 

h.  Criteria  for  mastery 

i .  Summary  table 

5.      Design  for  Instruction 


a.  Guide 

b.  Lessens 

5.     Supplemental  Source  Book 

a.  Glossary 

b.  Ilaterials  source  list 

7.  Low  Vision  Observation  Checklist 

8.  Packaging 

9.  Magnifiers 

10.  Placement  of  separate  components 

11.  rrogram  for  effectiveness 

A  copy  of  the  questionnaire  is  provided  in  Appendix  C.  Instruc- 
tions which  accompanied  the  materials  also  requested  the  teachers 
to  rake  rargin  notes  at  any  place  in  the  materials  vmere   clarifica- 
tion or  modification  was  needed. 

Procedure.  The  teachers  selected  were  contacted  by  American 
Printing  House  for  the  Blind  project  personnel  according  to  the 
criteria  established  and  detailed  in  the  Subject  section.  Teachers 
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were  asked  to  submit  a   list  of  their  students   along  with   identifying 
date  such  as   age,  sex,   grace   level,   visual   acuity,   field  of  vision, 
and  eye  condition.      From  this   list,   a  maximum  of  three  students  and 
one  alternate  were  selected  with  whom  each   teacher  would  work.      Each 
teacher  was   asked  to   fill   out  the   Low  Vision  Observation  Checklist 
and  administer  the  Diagnostic  Assessment  Procedure  to  each   student. 
On   the  oasis   of  the  assessment,   each   teacher  selected  the  appropri- 
ate lessons   to   use  with   each   student--as    identified  in  the  program-- 
in  a   course  of  instruction   to  improve  the  utilization  of  low  vision. 
Each   teacher  worked  with  ezch  s  ';udent   for  a  maximum  of  30  minutes 
per  day,    3  days   per  week,   for  8  consecutive  weeks.     At  the  comple- 
tion of  the   training   oerioa,   eacn   teacher  administered  the  Diagnostic 
Assessment  Procedure   again   to  determine   the  nature  and  extent  of 
the  cnange  from  pre-   to  postassessment.      Each   teacher  completed  the 
questionnaire  after  using  the  program  and   returned  all    materials   to 
the  American  Printing  House  for  the  Blind. 

Results   and  Discussion 


The  data  consisted  of  information  from  the  questionnaires   as 
to  the   usefulness  of   various  components  of  the  program,  along  with 
suggestions    for  improvement:  margin  notes   critiquing   the  program; 
and  pre-  and  postassessment  data.     The  field  evaluation  question- 
naire is   presented  in  Appendix  C  and  shews   how  the  teachers   responded 
to  each   of  the   59  questions   along  with   their  comments.     Wherever  the 
consensus   of  the  teachers   "indicated  that  sore  part  of  the  program 
needed   revision  or  clarification,    their  specific  comments   enabled 
American   Printing  House   for   the  Blind  personnel    to  pinpoint  the 
source  of  the  difficulty  so  that,  appropriate  changes  could  be  made. 
A  summary  of  the  responses   to  each  of  the  components   of   the  program 
is   as    follows: 

1.  Purpose— The  purpose  and  use  of  the  program  was   clear  to 
82"  of  the   teachers.     Of  the  teachers  who  reported  having 
a  problem,  only  one  teacher  provided  a  written  comment 
that  stated  that  the  program  was    ''clear  but  the  amount  of 
reading  was   overwhelming."     Consequently,   no  changes  were 
made  in  the  purpose. 

2.  Use  of  each   program  component— ATI    the  teachers   stated  that 
they  would   read  completely  or  read   carts   of  and  skim  the 
rest  of  the  Program  Guide,   Diagnostic  Assessment  Procedure, 
and   the  Design   for   Instruction.      For  the  Supplemental    Source 
Book,   82%  said  they  would  only  skim  it.     However,   none  of 
the  teachers    found  any  of  the  components   unnecessary. 

3.  Program  Guide—All    the   teachers    found  the  Program  Guide  to 
be  clearly  written  with  adequate  content  and  appropriate 

i  nfcrmati  on. 

4.  Diagnostic  Assessment   Procedure—All    the  teachers   found  the 
Evaluator's   Guide  clear,   appropriate,  and  consi stent  wi th 
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resptci    to  the  rationale  and  information  presented.     Hew- 
ever,   there  were  specific  problems  with  some  of  the  assess- 
ment materials,  namely: 

a.  Pen] ights — These  were  found  to  be  functioning  improperly 
and  consequently  were  replaced  with  different  penlights 
that  had  been   field  tested  previously. 

b.  Work  Mats--The  work  mats   tore  easily  and/or  did  not 
unfold  easily.      Consequently,   these  were  replaced  with 
felt  work  mats   thv.t  eliminated  both  problems   found   in 
the  field  evaluation. 

c.  Six  Million  Dollar  Man   Doll--A  number  of  problems  were 
indicated  with   the  doll    and,   consequently,  a  different 


d.     Cards   and  Shapes--]!"  e  problems   specified  have  primarily 
concerned  difficulties   related  to  manipulating  and 
sorting  the  cards.     Consequently,   the  packaging  of 
these  materials  was   chanced  to   facilitate  sorting  and 
ease  of  manipulation. 

5.  Design  for  Instruction—912  of  the  teachers   found  the  Design 
for  Instruction  clearly  written,   useful,   and  lessons   properly 

sequenced. 

6.  Supplemental   Source  Book--91£  of  the  teachers   found  the 
Sourcebook   to  be  appropriate  in  content,   clearly  written, 
and  useful.     However,   /Q%  or  the  teachers   did  not  use  any 
items   that  were  listed  in  the  Materials  Source  List  in 
working  with   their  students.     The  primary  reason  given  was 
lack  of  time  during  the  school   day. 

7.  Low  Vision  Observation  Checlist--90%  of  the  teachers   found 
the  Checklist  to  be  appropriate  in  format  and  content. 

8.  Packaging—Although  91%  of  the  teachers   found  the  packaging 
adequate,  40%  had  specific  suggestions  for  improving  it. 
These  suggestions   focused  en  making  a  lighter  weight  con- 
tainer with  better  handles.     Consequently,  the  packaging 
was  redesigned  to  conform  to  these  suggestions. 

9.  Magnifiers—These  were  included  in  the  program  so  that 
teachers  who  had  students   that  could  benefit  from  using 
magnifiers  would  have  them  readily  available.     There  were 
no  specific  assessment  iters  or  lessons  in  the  program  that 
addressed  the  use  of  magnifiers.     However,   it  was  apparent 
that  a   large  percentage  of  the  teachers   did  not  know  how 

to  assess  a  student's   needs  with  respect  to  the  use  of 
magnifiers.     Since  magnification  is  discussed  in  the  Source 
book  on  Low  Vision  and  detailed  instructions  on  the  assess- 
ment and  use  of  magnifiers   by   lew  vision  students  was  beyond 
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the  scope  of  this   program,   no  additional    instructional 
materials  were  added  to  the  program.     However,   the  decision 
was  made  to  include  three  magnifiers   in   the  program  for 
those  teachers   and/or  'learners  who  know  ho*//  to  use  them. 

10.  Placement  of  Separate  Components — 80%  of  the  teachers 
stated  tnat  the  Program  Guide  should  he  kept  as   a  separate 
volume.     However,   it  was   found  that  after  the  Program  Guide 
was   edited  in  final    form,   the  number  of  pages  were  so  few 
that  it  became  apparent  tnat  it  was   uneconomical   and 
impractical    to   keep  it  as   a  separate  volume.     Consequently, 
the  Program  Guide  and  Diagnostic  Assessment  Procedure  were 
combined  into  a  single  volume. 

11.  Program  Effect! veness--All    the  teachers   found  the  program 
to  oe  effective  with  91%  rating   it  as   excellent  and  9% 
found  it  very   useful   but   limited  in  scope.     Unsolicited 
comments   from  the  teachers   indicated  that  the  program  was 
precisely  what  they   needed  in  order  to  identify  students' 
visual    abilities   and  functional    limitations  and  to  improve 
visual    functioning  using  prepared   lessons  in  a  sequential 
p5'ccedure.     Additional   data  on  the  use  and  effectiveness 
of   the  program  are  evident  from  the  performance  of  the 
students   in   the  Diagnostic  Assessment  Procedure  which  was 
given  as   a  pretest  before   instruction  and  as  a  posttest 
after  instruction.      The  means,   ranges,  and  standard  devia- 
tions  of  the  assessment  time  on   the  pre-  and  postassess- 
ment,  the  number  of  days  between  the  pre-  and  postassess- 
rrsnt,   and   the  ore-  and  postassessment  scores   are  shown  in 
V.  sle  12.     The  amount  of  time  necessary   for  administering 

'  le  Diagnostic  Assessment  Procedure  decreased  substantially 
from  the.  pre-  and  postassessment  administration.     The 
preassessment  required   132.27  minutes   to  administer,  while 
the  postassessment  reouired  95.24  minutes  to  administer. 
The  mean  number  of  days  between  the  pre-  and  postassess- 
ment was  62,81   days.     On   the  preassessment  the  students' 
mean  performance  was   27.27  items,   and  on  the  postassess- 
ment it  was   31.68.  items.     The  difference  between  the  pre- 
and  postassessment  scores  was  significant  (t  =  6.43, 
cf  =21,   p  <    .001).     Of  the  22  students   in  the  study,   20 
students  showed  a  gain  from  ore-  to  postassessment,  one 
snowed  no  change,  ana  one  student  showed  a  decline  of  just 
one  item  from  ore-   to  posttest.     The  range  of  changes   from 
pre-   to  postassessment  test  extended  from  1   to   1 1   items. 
In   the  previous   study   the  mean  number  of  items   correct  on 
the  preassessment  was   23.4  which  compares  favorably  to  the 
"•a^n  of  27.27  en  Vne  preassessment  of  the  present  study. 
Co  ene  postassessment  of  the  previous  study  the  mean  was 
23.9   items.     Since  there  was   no  significant  change  from 
the   are-   to  postassessment  in  the  previous   study  in  which 
no  instruction  was   given  between  the  pre-  and  postassess- 
ment,  this   outcome  suggests   that   the  instructional   program 
was   effective   in  increasing  the  visual   efficiency  of  low 
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vision  students.  Of  more  sr 
frcrn  pre-  to  postassessment 
structure.  Table  13  shows  t 
?ra-   ana  postassessments ,  th 
pre-  to  postassessment ,  and 
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postassessment.  There  were 
10  postassessment  on  the  ite 
(A  and  5)  of  the  Diagnostic 
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items  correct  on  the  preasse 
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largest  changes  occurred  in 
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snowed  a  20.50%  increase  fro 
should  be  noted  that  on  the 
cated  a  sequential  difficult 
H  after  instruction,  and  iha 
unable  to  complete  these  ite 
the  instructional  program  co 
period  than  the  approximate! 
study  in  order  to  increase  t 
that  found  here. 


ecific  interest  are  the  changes 
as  a  function  of  the  category 
he  score  and  percentages  on 
e  mean  percentage  change  from 
the  number  of  students  who 
or   no  change  from  pre-  to 
little  or   no  changes  from  pre- 
ms  in  the  first  two  categories 
Assessment  Procedure.  This 
ost  all  the  students  got  these 
ss,ment  and  these  represent  the 
ioning  on  the  instrument.  The 
Category  E  which  involves  items 
crimination,  part-whole  rela- 
tail,  where  the  students 
ti  ore-  to  postassessment.  It 
oostassessment,  the  data  indi- 
/  from  Category  A  to  Category 
t  50%  of  the  students  were 
ns.  These  data  suggest  that 
uld  be  used  over  a  longer 
y  8  weeks  used  in  the  present 
le  use  of  low  vision  beyond 
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Summary  of  Statistics  on  the  Pre-  and  Postassessment 


Number  of  days  between 
pre-  and  postassessment 

Administration  tire  on 
preassessmant  (in  min.) 

Administration  time  on 
postassessment  (in  min.) 

Preassessment  scores 
(number  of  correct  items) 

Postassessment  scores 
(number  of  scorrect  items) 


Standard 

Mean 

Range 

deviation 

62.31 

36-98 

14.87 

132.27 

60-270 

57.89 

95.24 

45-120 

37.94 

27.27 

4-33 

9.76 

31  .56 

4-40 

10. '13 

26 


is*i»iii*i».«'1i  -_^i.-art'«v_-«-/;..,»^--..'-iJ---..-'-'-".»  ■-■■  s^AA^il' 


j***i&&t»i*L'&a.,B*Mr*  *m'\imft>iti^Mw^r-ifafc%HW;i*4l4^  o.u'.KiuuiiUii.ii —-  isi HiMSl&SiltbMM;  ■■■ 


...i.NU-jji'.  ....'.-..■ u  ..     !    .'_iiit»Lii:«. 


S 


o 

cri 

o 


-O  E 

(—  in 
(U 
i/> 
</> 
<o 

v» 
O 


E 

c 
is 

o 


No.  of  subjgcts 

who  showed  no 

charge 

CM 
CM 

Ol 

o 

VO 

„ 

o 

en 

f—             O 

No.  of  subjects 

who  snowed  (-) 

chance 

o 

o 

r— 

o 

No.  of  subjects 
who  snowed  (+) 
change 

o 

CM 

A 

CM 

INI 

o 

CT> 

■«-> 

1      V) 

at  <u 
C  at  s-  +J 

o  cnan 

3E   "3   E   O 
JC    O    Qj 
lr<i    O    l- 

H-    O 

o 

O 
O 

CO 
co 

o 
o 

<M 

uo 

O 

to 

CM 

</> 

«J 

10 

O 

ex. 

.xl 

o 

o 

o 

- 

CNJ 

o 

o 

iO 
CTi 
<0 

co 
co 

OO 
IT) 

oo 
ro 

o 
00 

co 

r-<» 
ft 

CM 
Ol 

CM 

co 

IT) 
OJ 

CT> 

CM 
if) 

CO 

o 
o 

- 

ro 

o 

o 
o 

<J3 

'.o 

2 

LO 

o 
o 

o 

o 

o 

OJ 

sx 

Ol 

ixl 

o 
o 

c-J 

o 
m 

O  B< 

o 

11") 

• 
en 

CM 
00 

CO 

§ 

• 

o 
in 

CO  b« 
CM 

r-. 
oo 

*— *      !  o 

<—  »«1   r—  *•« 
un |        \n 

ur>!         in 

CO                 UO 

CM        1    «3- 

(Vj                OJ 

o 
<-o 

• 
—  »c 
o 
m 

'4 
m 

CO 

CM 

^-  as 

oo 
ro 

uO 

CM   «3 

-     •  — , 
eft 

JO 

CO 
CO 


CM 
CM 


CO 


27 


-  .  ......  -  ...  .......  .....,.,., 


...  . ,.-.«rt^ 


r  -..  T, ^_*^^,.^.^n^^ ... .-  ..<.,  ......j-  ■ .  .  ...  .  • .-...  _■.— ..•■.^ .. 


mmmtmnmaJeamamBama^Bea^SFSSSSSn^S^iS^SS^BxZ 


^LS^ssSbSsr^s 


.-wi.»j»W- ,.*.«.,•>;•(-.•'-  --"     "      «"sn« 


After  admi  m'ster 

mg  the  preass 

able  to  select  the  a  a 

oropriate  less 

instructional  program 

As  a  group, 

used  by  one  or   more  c 

f  the  teachers 

number  of  tires  each 

"ess en  was  ^s? 

Each  teacher  made  mar 

ain  notes  on  e 

indicating  changes  tr, 

ey  wan tea  race 

completed  an  individu 

3.1  lesson  eval 

actual ly  used  wi th  3 

student.  _re 

materials  were  cornpi  1 

ed,  summarized 

Printing  House  for  tr 

3  Blind  person 

were  made  in  the  wri  t 

-.en  materia  1  . 

given  to  a  profession 

al  editor  fcr 

turned  over  to  oroduc 

:i  on . 

essment  all    the 
ens    to  be  used  a 

141    of   the   150 
I  he   lessons    u 
d   is   s n 0 ■/ n   i n  A 0 
ach  of   the   lesso 
In   sedition  e 
uation   form  for 
margin   notes   on 
,   ana   reviewed  b 
nel   ana  appropri 

Al  1   wri  tten  mat 
f'i  nal    edi  ti  ng  be 


teachers  were 
s   part  of  an 
lessons  were 

sed  and  the 
pendix  D. 
ns  they  used 
ach  teacher 
each  lesson 


ill 


le  written 


y  American 
ate  changes 
erial   was   then 
fore  being 


In  summary,    the   "meld  evaluation  showed   that   the  program 
could  be  used  by   teachers   of  the   visually  handicapped,  without 
additional    training,   to  facilitate   the  use  of  residual    vision  in 
low  vision  students.       \  number  of  problems  with   the  materials  were 
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The  Program  is   available  from  the  American  Printing  House   for 
the  Blind  in  Louisville,   Kentucky. 
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Department  of  Special  Education 
School  of  Education 
University  cf  Louisville 
Louisville,  Kentucky  40208 

Mrs  .  Joyce  Bromley 
Si ght  Conservationist 
Materials  Center  for  Visually 

Handicapped 
Knox vi lie  Ci t y  School s 
925  Oglewood  Avenue,  Room  24 
KnoxviPe,  Tennessee  37917 

Mrs.  Pat  Carpenter 
Education  Consultant 
Visual  Iv  Impaired  Pro  cram 

Jib  County  School  System 
2-:oart:nent  of  Special  Education 

i  :bert  Shaw  Center 
235  Glendale  Road 
Scottdale,  Georgia  20079 

Mrs.  Ruth  Holmes 
Educator  and  Consultant 
Illinois  School  for  the  Visually 

Hanoi  capped 
658  East  State  Street 
Jacksonville,  1 1  linens  62650 


r.  - 


Cc 


L-c 


... 


0v 


;ervisor   vision  services 

ion  Ssrvi ces   Center 
itgomery  County  Public  Schools 

3  :  Dor! and  Lane 
ihesda,   Maryland  20014 

.   Oouglss   K.   Ozias 

uty  Director 

error's   Coordinating  Office  for 
:~,e    /isi  i]  ly  Handicapped 

ikes  Building 
te   105 
;tin,   Texas   78701 

Earl  F.  Rankin 

fessor  c f  Education 
jartment  of  Curriculum  and 
.  "s cructi en 

:  ;ee  of  Education 

'. ersity  of  Kentucky 
;ir>gton,  Kentucky  40505 

"  -  y.  t,     y  i  1  1  on     c  ■-,       • 

ti  tut  e  cf  Chi  Id  Study 

C  .  !  ie    2  of  Mj.v  Jersey 
*ris  Avenue 
on,  fiew  Jersey  07033 

; .    <ose  SkolnicK 

:dv   Vision  Stimulation  Program 

rbrook  School    for  the  Blind 
Street  and  ;  ;ivern  Avenue 

!    ieiphia,   Pennsylvania   19151 


■:  '■:■.'■    ^  -'-    d  >;'<  th 


Mrs  .   Wi  lma  A.    Hul  1 

163  Grove  Street 
[  .  a  ngton,   Mass  .   0 


s   School    ^or  the  Blind 

. :        th  S  treet 
en,    fexas    78756 


Dr.  Randy  Jose 

Center  for  the  Bl ind 

35th  Street  and  Lancaster  Avenue 

Philadelphia,  Pennsylvania  19104 


:  -::n  W.  Tuttle 
eclate  Professor,  Area  Coordinator 
f ersity  of  Northern  Colorado 
v ,  Colorado  80531 
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y,***^^^  "' 9   >fr  "  "  "  *?W, 


Lesson  No. 


Individual  Lesson  Evaluation  Form 
tudent  Teacher 


P  a .-,  c  o  n  c  /  \ 


ns/  bucc;es  tiers 


1.   Did  the  lesson  address  its 
objecti  ve? 


2.  »as  the  oroceoure  clear.' 


3.  Were  you  able  to  use  this 
lesson  i n  w o r k i n g  w i  th  the 

student? 


Were  ne  tangible  materials 
n e c e s s a r  y  f or  t e a c h i n g  t n e 
lesson  easily  acquired? 


j  7.  Were  the  response  criteria 
speci  fi  c  enough  so  that  it 
was  clear  whether  the  \nirr.er 
rformed  correctly  or   incor- 
rectly? 


Were  the  procedural  notes 
cl ear  and  he! pful ? 


T 


...    the  sect  icn  on  add!  ti  ona  1  i 
acti  vi  ties   adequate? 

! 


5. 

Were  the  materials  listen 

on  the  lesson  plan  suffi- 

cient to  teach  this  lesson?   i 

i 

6 . 

]  i  g r s p hies  w e r e  included  in  j 

this  lesson,  did  you  think 

they  were  clear  ana  suffici-      ; 

ent  to  teach  what  was 

i ;   ! ended? 

/era  11    di d    /ou    f i n J   this 
]  L-sson  useful  ? 


<J  i. 


.  . .  a bis* U.JiL-«^..-  x'i*^A-^idii*ii 


p  2  n  d  1  x  C 


Field  Evaluation  Questionnaire 
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Frequency  of  Lessons   Used 


No.  of  Times  Each 

No.  of  Times  Each 

Lesson  No. 

Lesson  Was  Used 

Lesson  No. 

Lesson  Was  Used 

1 

3 

48 

3 

2 

3 

49 

3 

3 

3 

50 

3 

4 

3 

51 

5 

5 

3 

52 

4 

6 

3 

53 

3 

7 

3 

54 

4 

8 

3 

55 

3 

9 

3 

56 

2 

10 

3 

57 

4 

11 

3 

58 

4 

12 

3 

69 

6 

13 

3 

60 

7 

14 

3 

61 

9 

15 

2 

62 

10 

16 

63 

9 

17 

2 

64 

8 

18 

2 

65 

4 

19 

1 

66 

3 

20 

1 

67 

3 

21 

3 

68 

2 

22 

4 

69 

2 

23 

4 

70 

1 

24 

6 

71 

1 

25 

5 

72 

2 

26 

8 

73 

3 

27 

7 

74 

2 

23 

6 

75 

1 

29 

6 

76 

2 

30 

5 

77 

3 

31 

1  7 

78 

1 

32 

1  1 

79 

0 

33 

t 

80 

0 

34 

4 

81 

0 

35 

5 

82 

2 

35 

3 

83 

1 

37 

5 

84 

3 

38 

4 

85 

6 

39 

4 

86 

4 

40 

4 

87 

4 

41 

4 

88 

4 

42 

4 

89 

4 

43 

4 

90 

3 

44 

5 

91 

1 

45 

4 

92 

1 

46 

4 

93 

0 

47 

3 

94 

1 

59 


li 


my 

i 


No.  of  Times  Each 

Lessen  No. 

Lesson  Was  Used 

95 

0 

96 

0 

97 

1 

98 

7 

99 

5 

100 

7 

101 

3 

102 

2 

103 

6 

104 

5 

105 

6 

106 

6 

107 

7 

103 

3 

109 

4 

110 

7 

111 

8 

112 

7 

1 1 3 

1 

114 

1 

115 

0 

116 

2 

177 

1 

1 1 8 

2 

119 

1 

120 

3 

121 

1 

122 

1 

123 

1 

124 

1 

125 

1 

125 

1 

127 

5 

123 

5 

129 

3 

130 

3 

131 

4 

132 

4 

133 

4 

134 

2 

135 

2 

135 

2 

137 

3 

138 

2 

139 

2 

140 

2 

141 

3 

142 

4 

143 

1 

Lesson  No 

144 
145 

146 
147 
148 
149 
150 


Mo.  of  Tines  Eacf 
Lesson  Was  Used 

2 
1 
2 

0 
0 
2 
1 
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